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WHAT IS CLAIMED IS: 

1. A system for assessing viewer response to television 
programming that can be associated with information describing the 
programming content, said system comprising: 

a receiver for receiving and displaying television 
programming; 

at least one sensor for sensing a physical reaction by 
the viewer viewing the displayed programming and generating a 
signal representative of the physical reaction; and 

a processor for receiving the sensor signal and analyzing 
it to determine if it can be associated with at least one 
recognizable viewer response, whereupon the processor associates 
the recognized response with a descriptive information relating to 
the program that was being displayed when the physical reaction was 
sensed. 

2. The system of claim 1, further comprising a memory device for 
storing the association between the programming description and 
sensed reaction as a viewer preference. 
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3. The system according to claim 1, wherein the at least one 
sensor comprises a plurality of sensors. 

4. The system of claim 3, further comprising a sensor-signal 
receiver for receiving the signals generated by at least some of 
the plurality of sensors. 

5. The system of claim 4, wherein the sensor- signal receiver 
combines the received sensor signals so that the processor may 
analyze an aggregation of sensors signals. 

6. The system of claim 1, wherein the at least one sensor is 
a video image capturing device. 

7. The system of claim 6, further comprising a video 
processor in communication with the video camera, the video 
processor comprising an image library for comparing to video images 
received from the video camera. 

8. The system of claim 6, further comprising a video 
recorder for recording the images captured by the video camera. 
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1 9. The system of claim 1, wherein the at least one sensor is 

2 a microphone for picking up vocalizations made by the viewer. 

1 10. The system of claim 1, further comprising an 

2 environmental sensor for sensing a change in the viewing 

3 environment and transmitting environmental information to the 

4 processor for use in analyzing viewer physical reactions. 

1U 11- A method of assessing viewer response to television 

0 programming that includes one or more distinct segments, said 
3p= method comprising the steps of: 

42J providing a receiver on which the viewer may view the 

1 s programming ; 

|& monitoring at least one viewer physical condition; and 

B associating a perceived physical -condition status with a 

8 viewer response. 

1 12. The method of claim 11, wherein in the monitoring step 

2 includes monitoring a plurality of viewer physical conditions. 
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1 13. The method of claim 11, wherein the physical condition 

2 status includes a change in the physical condition relative to a 

3 baseline level, the change being perceived during the monitoring 

4 step. 

1 14. The method of claim 11, wherein the physical condition is 

2 body temperature. 

1 15. The method of claim 11, wherein the physical condition is 
jaj heart rate. 

I ! f 16. The method of claim 11, wherein the monitoring step is 

# performed by an image -capturing device for capturing images of the 

;;| viewer viewing the programming. 

II: 3 

© 17. The method of claim 16, further comprising the step of 

y, 

2 providing a video processor for receiving the video images captured 

3 by the video camera and comparing them to reference data to 

4 interpret a viewer movement represented in the captured images. 
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18. The method of claim 11, further comprising the steps of: 
determining at least one distinguishing characteristic of 

a displayed programming segment; 

associating a viewer response corresponding to a physical 
condition perceived during the display of the programming segment 
with a viewer preference level; and 

applying the preference level to enhance program 

selection. 

19. The method of claim 18, wherein program selection is 
enhanced by providing a notification that specified future 
programming will contain at least one segment possessing the at 
least one distinguishing characteristic. 

20. The method of claim 18, wherein the program selection is 
enhanced by inserting into a program a segment possessing the at 
least one distinguishing characteristic. 



21. The method of claim 18, wherein the program 
distinguishing characteristic is derived from electronic program 
guide (EPG) information provided with the television programming. 
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1 22. The method of claim 18, wherein the program segment 

2 distinguishing characteristic is derived from audio, video and text 

3 signal properties of television programming. 

1 23. The method of claim 11, further comprising the steps 

2 of : 

3 providing a recorder coupled to the receiver to record 

4 selected program segments; 

%, determining when a program segment is being received 

|I that corresponds to a pre-selected viewer response previously 

jj& associated with a physical -condition status; and 
# automatically recording the program segment. 

If! 

jy~ 

|7 24. The method of claim 11, further comprising the steps 

m of : 

3 determining when a program segment is being received 

4 that corresponds to a pre-selected viewer response previously 

5 associated with a physical -condition status; 

6 extracting information related to the program segment 

7 from the television programming; and 

8 automatically displaying the information on the 

9 receiver. 
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1 25. The method of claim 11, wherein the monitored physical 

2 condition viewer physical condition is a biometric response. 

1 26. The method of claim 25, wherein the biometric response 

2 is galvactic skin response. 

1 27. The method of claim 11, wherein the monitoring step 

2 comprises monitoring a visually observable response. 

© 28 • Tne method of claim 27, wherein the visually 

* observable response is related to the gaze of the viewer. 

,g 29. The method of claim 28, wherein the gaze-related 

pi, response includes the direction of the viewer's gaze. 

li ■ 

II 30. The method of claim 28, wherein the gaze-related 

y= 

r response includes the duration of the viewer's gaze in a certain 

3 direction before changing to a different direction. 

1 31. The method of claim 27, wherein the visually 

2 observable response includes the furrowing of the viewer's brow. 
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32. The method of claim 31, wherein the monitoring step 
includes measuring the depth of any furrows in the viewer's 
brow, tending to indicate confusion or lack of understanding. 

33. The method of claim 11, wherein the associating step 
is performed at least in part by using the Hidden Markov Model 
technique . 
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1 34. A method of assessing listener response to audio 

2 programming that includes one or more distinct segments, said 

3 method comprising the steps of: 

4 providing a receiver having a speaker for presenting 

5 the audio programming to the listener; 

6 monitoring at least one listener physical condition; 

7 and 

8 associating a perceived physical -condition status with 



a viewer response , 



35. The method of claim 34, wherein the monitoring step 



iJ comprises monitoring a audibly observable response. 

.« 

u 

|^ 36. The method of claim 34, wherein the audibly observable 

|| response is listener laughter. 

1 37. The method of claim 34, wherein the audibly observable 

2 response is the inflection of a listener's vocalization, tending 

3 to indicate a question has been enunciated. 

1 38. The method of claim 34, wherein the associating step 

2 is performed at least in part by using the Hidden Markov Model 

3 technique . 
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